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Abstract. The probabilistic modal ^t-calculus is a fixed-point logic designed for expressing 
properties of probabilistic labeled transition systems (PLTS's). Two equivalent semantics 
have been studied for this logic, both assigning to each state a value in the interval [0, 1] 
representing the probability that the property expressed by the formula holds at the state. 
One semantics is denotational and the other is a game semantics, specified in terms of 
two-player stochastic parity games. 

A shortcoming of the probabilistic modal /i-calculus is the lack of expressiveness required 
to encode other important temporal logics for PLTS's such as Probabilistic Computation 
Tree Logic (PCTL). To address this limitation we extend the logic with a new pair of 
operators: independent product and coproduct. The resulting logic, called probabilistic 
modal [i-calculus with independent product, can encode many properties of interest and 
subsumes the qualitative fragment of PCTL. 

The main contribution of this paper is the definition of an appropriate game semantics 
for this extended probabilistic /i-calculus. This relies on the definition of a new class of 
games which generalize standard two-player stochastic (parity) games by allowing a play 
to be split into concurrent subplays, each continuing their evolution independently. Our 
main technical result is the equivalence of the two semantics. The proof is carried out in 
ZFC set theory extended with Martin's Axiom at an uncountable cardinal. 



1. Introduction 

The modal //-calculus (L/i) [IBJ USB E] is a very expressive logic, for expressing properties 
of labeled transition systems (LTS's), obtained by extending classical propositional modal 
logic with least and greatest fixed point operators. In the last decade, a lot of research has 
focused on the study of reactive systems that exhibit some kind of probabilistic behavior, 
and logics for expressing their properties. Probabilistic labeled transition systems (PLTS's) 
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|29j are a natural generalization of standard LTS's to the probabilistic scenario, as they 
allow both non-deterministic and (countable) probabilistic choices. A state s in a PLTS 
can evolve by non-deterministically choosing one of the accessible probability distributions d 
(over states) and then continuing its execution from the state s' with probability d(s'). This 
combination of non-deterministic choices immediately followed by probabilistic ones, allows 
the modeling of concurrency, non-determinism and probabilistic behaviors in a natural 
way. PTLS's can be visualized using graphs labeled with probabilities in a natural way 
[TBI IT9l [JJ. For example the PLTS depicted in Figure [JJ models a system with two states 
p and q. At the state q no action can be performed. At the state p the system can evolve 
non-deterministically either to the state q with probability 1 (when the transition p —> c?2 
is chosen) or to the state p with probability ^ and to the state q and with probability | 
(when the transition p — ^4 d% is chosen). 

1 2 

3 3 

1 



Figure 1: Example of a PLTS 

The probabilistic modal ^-calculus (pL/i), introduced in [27J QE], is a generaliza- 
tion of L/i designed for expressing properties of PLTS's. This logic was originally named 
the quantitative /i-calculus, but since other //-calculus-like logics, designed for expressing 
properties of non-probabilistic systems, have been given the same name (see, e.g., [llj), we 
adopt the probabilistic adjective. The syntax of the logic pL/i coincides with that of the 
standard ^-calculus. The denotational semantics of pL/i (27J [10] generalizes that of L/i, by 
interpreting every formula F as a map 1_FJ :P— >■ [0, 1], which assigns to each state p a degree 
of truth. In [23J, the authors introduce an alternative semantics for the logic pL/i. This 
semantics, given in term of two-player stochastic parity games, is a natural generalization 
of the two-player (non stochastic) game semantics for the logic L/i [30J. As in L/i games, the 
two players play a game starting from a configuration (p, F), where the objective for Player 
1 is to produce a path of configurations along which the outermost fixed point variable X 
unfolded infinitely often is bound by a greatest fixed point in F. On a configuration of the 
form (p,Gi V G2), Player 1 chooses one of the disjuncts Gi, i € {1,2}, by moving to the 
next configuration (p, Gi). On a configuration (p, G\ A G2), Player 2 chooses a conjunct Gi 
and moves to {p,Gi). On a configuration (p,fj,X.G) or (p,uX.G) the game evolves to the 
configuration (p,G), after which, from any subsequent configuration (q,X) the game again 
evolves to (q,G). On configurations (p,(a)G) and (p,[a]G), Player 1 and 2 respectively 
choose a transition p—>d in the PLTS and move the game to (d, G). Here d is a probabil- 
ity distribution (this is the key difference between pL/i and L/i games) and the configuration 
{d, G) belongs to Nature, the probabilistic agent of the game, who moves on to the next 
configuration (q,G) with probability d(q). This game semantics allows one to interpret 
formulas as expressing, for each state p, the (limit) probability of a property, specified by 
the formula, holding at the state p. In [23] , the equivalence of the denotational and game 
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semantics for pL// on all finite models, was proven. The result was recently extended to 
arbitrary models by the present author |26j . 

Having a complementary game semantics for the logic pL/x is of great conceptual im- 
portance. In the quantitative approach to probabilistic temporal logics, the truth value 
associated with a formula at a given state is supposed to represent the probability that the 
property expressed by the formula holds at the state. Since the connectives of pL^ can 
be given other meaningful denotational interpretations different from those considered in 
[271 HI)] (see, e.g., [H]), one naturally seeks an alternative description for the properties 
associated with formulas going beyond the mere denotational interpretation. The game 
semantics for pL/z provides such an operational interpretation in terms of the interactions 
between the controller (Player 1) and a hostile environment (Player 2) in the context of the 
stochastic choices occurring in the PLTS (Nature). 

However, a shortcoming of the probabilistic /U-calculus is the lack of expressiveness 
required to encode other important temporal logics for PLTS's, such as Probabilistic Com- 
putation Tree Logic (PCTL) of [2]. To address this limitation, we consider an extension of 
the logic pL/i obtained by adding to the syntax of the logic a second conjunction operator (•) 
called product and its De Morgan dual operator called coproduct (0). We call this extension 
the probabilistic modal fi-calculus with independent product, or just pL^u . The denotational 
semantics of the product operator is defined as [-F-G] (p) = IF} (p) ■ [G] (p), where the product 
symbol in the right hand side is multiplication on reals. The denotational semantics of the 
coproduct is defined, by De Morgan duality, as [F0G](p) = 1- ((1 - {Fj{p)) ■ (1 - {Gj{p))) . 
These operators were already considered in [14] as a possible generalization of standard 
boolean conjunction and disjunction to the lattice [0,1]. Our logic pL// is novel in con- 
taining both ordinary conjunctions and disjunctions (A and V) and independent products 
and coproducts (• and 0). While giving a denotational semantics to pL/i is straightfor- 
ward, the major task we undertake in this paper is to extend the game semantics of [23] 
to the new connectives. The conceptual importance of this kind of result has already been 
outlined above (see also |25[ §1] for an extensive exposition). The game semantics imple- 
ments the intuition that Hi ■ H2 expresses the probability that Hi and H2 both hold if 
verified independently of each other. 

To capture formally this intuition we introduce a game semantics for the logic pL^ in 
which independent execution of many instances of the game is allowed. Our games build 
on those for pL/x outlined above. Novelty arises in the game interpretation of the game 
states (p,Hi-H2) and {p,Hi i^)- When during the execution of the game one of this 
kind of nodes is reached, the game is split into two concurrent and independent subgames 
continuing their executions from the states (p,Hi) and (p, H2) respectively. The difference 
between the game-interpretation of product and coproduct operators is that on a product 
configuration (p,Hi ■ H2), Player 1 has to win in both generated sub-games, while on a 
coproduct configuration (p,Hi H2), Player 1 needs to win just one of the two generated 
sub-games. 

To illustrate the main ideas, let us consider the PLTS of figure 2(a) and the pL^u for- 
mula F= (a)(a)tt which asserts the possibility of performing two consecutive a-steps. The 
probability of F being satisfied at p is ^, since after the first a-step, the state is reached 
with probability ^ and no further a-step is possible. Let us consider the pL/i formula 
H = /iX.(F X). Figure 2(b) depicts a play in the game starting from the configuration 
{p,H) (fixed-point unfolding steps are omitted). The branching points represent places 
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(a) Example of PLTS 

Figure 2: Illustrative example 

where coproduct is the main connective, and each Tj represents play in one of the inde- 
pendent subgames for {p, F) thereupon generated. We call such a tree, describing play on 
all independent subgames, a branching play. Since all branches are coproducts, and the 
fixpoint is a least fixpoint, the objective for Player 1 is to win at least one of the games 
Tj. Since the probability of winning a particular game Tj is i, and there are infinitely 
many independent such games, the probability of Player 1 winning the whole game H is 1. 
Therefore the game semantics assigns H at p the value 1. 

The above example illustrates an interesting application of the new operators, namely 
the possibility of encoding the qualitative probabilistic modalities F > qF (F holds with 
probability greater than zero) and ¥ = \F (F holds with probability 1), which are equivalent 
to the pL//® formulas fiX.{F X) and vX.(F ■ X) respectively. Other useful properties can 
be expressed by using these probabilistic modalities in the scope of fixed point operators. 
Some interesting formulas include fj,X.((a)X\/(F =1 H)) , uX.(F >0 {a)X) and P >0 (^X.(a)X) . 
The first formula assigns to a state p the probability of eventually reaching, by means of a 
sequence of a-steps, a state in which H holds with probability 1. The second, interpreted on 
a state p, has value 1 if there exists an infinite sequence of possible (in the sense of having 
probabilty greater than 0) a-steps starting from p, and otherwise. The third formula, 
expresses a stronger property, namely it assigns to a state p value 1 if the probability 
of making (starting from p) an infinite sequence of a-steps is greater than 0, and value 
otherwise. As a matter of fact the logic pL/i® is expressive enough to encode the qualitative 
fragment of PCTL. 

Formalizing the pL/i® games outlined above is a surprisingly technical undertaking. 
To account for the branching plays that arise, we introduce a general notion of tree game 
which is of interest in its own right. Tree games generalize two-player stochastic games, and 
are powerful enough to encode certain classes of games of imperfect information such as 
Blackwell games [21 J. A further level of difficulty arises in expressing when a branching play 
in a pL/i® game is considered an objective for Player 1. This is delicate because branching 
plays can contain infinitely many interleaved occurrences of product and coproduct oper- 
ations (so our simple explanation of such nodes above does not suffice). To account for 
this, branching plays are themselves considered as ordinary two-player (parity) games with 
coproduct nodes as Player 1 nodes, and product nodes as Player 2 nodes. Player l's goal in 
the outer pL/x® game is to produce a branching play for which, when itself considered as a 
game, the inner game, they have a winning strategy. To formalize the class of tree games 
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whose objective is specified by means of inner games, we introduce the notion of two-player 
stochastic meta-parity game. 

Our main technical result is the equivalence of the denotational semantics and the game 
semantics for the logic pL/i®. As in j26j the proof of equivalence of the two semantics is 
based on the unfolding method of [11 j . However there are significant complications, notably, 
the transfinite inductive characterization of the set of winning branching plays in a given 
pL/i® game (section [6j) and the lack of denotational continuity on the free variables taken 
care by the game-theoretic notion of robust Markov branching play (Section [7J). Moreover, 
because of the complexity of the objectives described by means of inner games, the proof is 
carried out in ZFC set theory extended with MA^ (Martin's Axiom at Ni) and therefore 
our result is at least consistent with ZFC. We leave open the question of whether our result 
is provable in ZFC alone; we do not know if this is possible even restricting the equivalence 
problem to finite models. 

The rest of the paper is organized as follows. In Section [2] we discuss the required 
mathematical background. In Section[3]we define the syntax and the denotational semantics 
of the logic pL// . In Section H] the class of stochastic tree games, and its sub-class given by 
two-player stochastic meta-parity games, are introduced in detail. In Section [5] the game 
semantics of the logic pL/i® is defined in terms of two-player stochastic meta-parity games. 
In Section [6] we provide a transfinite inductive characterization of the winning set of the 
game associated with a formula /iX.F. In Section [7] we introduce the technical notion of 
robust Markov branching play. In Section [8] we prove the equivalence of the two semantics, 
our main result. Conclusions and directions for future research are presented in Section [9j 

2. Mathematical Background 

Definition 2.1. A (discrete) probability distribution d over a set A is a function d: X — > 
[0,1] such that J2xex ^( x ) = The su PP or t of d, denoted by supp(cf), is defined as the 
(necessarily countable) set {xGA | d(x)>0}. We denote with V{X) the set of probability 
distributions over X. We denote with S x , for x G X, the unique probability distribution 
such that supp(<5a;) = {x}. 

Definition 2.2 (PLTS [29J). Given a countable set L of labels, a Probabilistic Labeled 
Transition System is a pair £ = (P, {— — >} a eL); where P is a countable set of states and 
— CPx T>(P), for every a € L. In this paper we restrict our attention to those PLTS's 
such that for every pGP and every a G L, the set {d | p d} is countable. We refer 
to the countable set UaeiUpepi^ I P ~^ denoted by T>(£), as the set of probability 
distributions of the PLTS. We say that a PLTS C is not-probabilisitc, or just a LTS, if every 
probability distribution d£T>(£) is of the form 5 p , for some p£P. 

Given a set X, we denote with 2 X the set of all subsets Y C X. Given a complete 
lattice (L, <), we denote with |J : 2 L — > L and f~| : 2 L — > L the operations of join and meet 
respectively. A function f-.L^-L is monotone if x<y implies f{x)<f(y), for every x,y€L. 
The set of fixed points of any monotone function f : L — >L, ordered by <, is a non-empty 
complete lattice [32J. We denote with lfp(/) and gfp(/) the least and the greatest fixed 
points of /, respectively. 

Theorem 2.3 (Knaster-Tarski |32j). Let (L,<) be a complete lattice and f : L — > L a 
monotone function. The following equalities hold: 
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(1) lfp(/) = \J a f a , ^ere f a = Up< a Hf P ), 

(2) gfp(/) = U a fa, where f a = f\ p<a f(fp), 
where the greek letters a and (3 range over ordinals. 

The closed real interval [0,1], with its standard order <, is a (distributive) complete 
lattice [25] with |J X = supX and f| X = inf X, for every X C [0, 1]. When X = {x, y} we 
simply have xUy = max{x, y} and xfly = min{x, y}. The involutive map x i— > 1—x is clearly 
order-reversing, thus the structure ([0, 1], <, Xx.l — x) constitutes a complete De Morgan 
algebra. We shall consider the operation of product (•), i.e., standard multiplication on [0, 1], 

and its De Morgan dual, called coproduct (©), defined as: x y = f 1 — ((1 — x) ■ (1 — y)). 
Equivalently, x y = x + y — xy. Both operations are commutative, associative, monotone 
and extend uniquely to infinitary operations of type Y\, II : [0> 1] N ~~ > [0> 1] as follows: 

[^{SnlneN = ["I X ° ' ' ' ' ' Xm alld JJi^nlngN = [_\ X . . . X m . 

We shall make use of the following fast growing function on the natural numbers to approx- 
imate infinite (co) products. 

Definition 2.4. The function #:N^N is defined as #(n) d = 2 2 " +1 . 

Proposition 2.5. The following inequalities hold for every e S (0, 1] and x n £ [0, 1] N ; 

n ( x « + < ( n x «) + e and n ^ - #fcy) > ( n x «) - e 

ngN " ^ ' neN n&\ ' n&i 

and, similarly, if infinitary products are replaced by infinitary coproducts. 

Proof. Both inequalities are easily proved by routine methods. We refer to Lemma 2.2.10 
of [25] for a detailed proof. □ 



In the following we assume standard notions of basic topology and basic measure theory. 
We refer to |17| and [31] as standard references to these topics. The author's PhD thesis 
[25\ Chapter 2] provides a succinct introduction to the necessary material. The topological 
spaces we consider will always be 0-dimensional Polish spaces. 

Adopting standard notation, we denote with r°, for re{£,n,A} and a a countable 
ordinal greater than 0, the corresponding class of subsets (of a Polish space) in the Borel 
hierarchy. In particular, A] 1 , and LT^ denote the collections of clopen, open and closed 
sets respectively. 

Definition 2.6. For each n>l the projective classes Tl n (X), II^(X), A. n (X) of subsets of 
a Polish space X are defined as follows: 

£^ +1 = |ACX I A = {x | 3y.(x,y)£B} for some BelL^X x Y)\ 

n* +1 = {aqx | (x\A)eK + i(x)} 
K = KriK 

where Y is a Polish space, and X x Y is equipped with the product topology. It is a well- 
known result of Susin (see, e.g., Theorem 14.11 in [17]) that is the collection of Borel 
sets. Thus the class of projective sets is defined, starting from the Borel sets, by iterating 
the operations of projection and complementation. 

Definition 2.7. Given a Polish space X and a subset ACX, we say that A is universally 
measurable if it is /U- measurable for every Borel probability measure on X. It follows that 
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the collection of universally measurable subsets of X, denoted by UM(X), forms a cr-algebra. 
Given a measurable space (Y, S) and a function / : X —tY, we say that / is universally 
measurable if GUM(I) for all SeS. 

The following facts will be useful. 

Theorem 2.8. Let X be a Polish space. The following assertions hold: 

(1) Sj(X) C XJM.(X), and if X is uncountable the inclusion is strict. 

(2) IfAeUM(Y) and f:X ^Y is universally measurable, then / -1 (j4.) eUM(l). 

It is not possible, in ZFC alone, to show that universally measurable sets extend any 
further up in the projective hierarchy. 

Theorem 2.9. Let X be a Polish space. If ZFC is consistent the following assertions hold: 

(1) ZFCF Al(X) C UM(X), 

(2) ZFCF Al(X) C UM(X). 

Proof. The result of the first assertion is due to Kurt Godel, see, e.g., Corollary 25.28 of 
[15j . A proof of the second assertion can be found in, e.g., [22]. □ 

Thus, it is not decidable in ZFC if every set in A^(X) is universally measurable. As 
we shall see in later sections, the winning sets of pL/i® games are, in general, A3>(A) 
sets. To deal with the associated measure theoretic issues, we will carry our main result 
in ZFC + MAjtj set theory, where MA^ is the so-called Martin's Axiom at Ni, the first 
uncountable cardinal. We often identify with the least uncountable ordinal uj\. We refer 
to [22l ES] for a description of the axiom MA^ and some of its set-theoretic consequences. 
Here we list those that are relevant to our work. 

Theorem 2.10 (|22j). Let X be a Polish space, /i be a Borel probability measure on X 
and {Aa} a<LxJl a collection of [i- measurable subsets of X, where uj\ is the least uncountable 
ordinal. The following assertions hold in ZFC + MA^ X : 

(1) Al(X) C UM(X), 

(2) completeness: \J a<UJl A a is a ^-measurable set, 

(3) us i -continuity: A t (U Q <aji 

a 1 ■ 

Note that, since singleton sets are always closed (hence measurable) in Polish spaces, it 
follows immediately from Theorem l2,10l that Martin's Axiom at implies 2^° ^ Ki, i.e., the 
negation of Continuum Hypothesis [15] . As a matter of fact, Martin's Axiom was introduced 
by the authors as a possible set-theoretic alternative to the Continuum Hypothesis [22]. 

3. The logic pL^° 

Given a set Var of propositional variables ranged over by the letters X, Y and Z, and a set 
of labels L ranged over by the letters a, b and c, the formulas of the logic pL/i® are defined 
by the following grammar: 

F, G ::= X | F A G \ F V G \ F ■ G \ F G \ [a]F \ (a)F | uX.F \ fiX.F 
which extends the syntax of the probabilistic modal //-calculus (pL/x) with a new kind of 
conjunction (•) and disjunction (©) operators called product and coproduct respectively. As 
usual the operators vX.F and [xX.F bind the variable X in F . A formula is closed if it has 
no free variables. 
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Definition 3.1 (Subformula). We define the set Sub(F) by case analysis on F as follows: 

Sub(X) = {X}, Sub( [a] F) = { [a] F} U Sub(F) , Sub(F l A F 2 ) = {F l A F 2 } U Sub(F 1 ) U Sub(F 2 ) , 
5«6(Fi • F 2 ) = {Fi • F 2 } U 5u6(Fi) U Su6(F 2 ) and Sub(vX.F) = {z/XF} U Su6(F). The cases 
for the connectives (a), V, and pX are defined as for their duals. We say that G is a 
subformula of F if G £ Sub(F). 

Given a PLTS (F, {-%} ae i) we denote with [0, l] p the complete lattice of functions 
from F to the real interval [0, 1] with the pointwise order. A function p : Var — )• [0, l] p 
is called a [0, l]-valued interpretation, or just an interpretation, of the variables. Given a 
function / : F— )• [0, 1] we denote with p[f /X] the interpretation that assigns / to the variable 
X, and p(Y) to all other variables Y. 

The denotational semantics {F} p : F — >■ [0, 1] of the pL// formula F, under the inter- 
pretation p, is defined by structural induction on F as follows: 

ixj p (p) = p(x)( P ) 

lGVHj p (p) = [GI„(p)U[H} p (p) 

lGAHj p (p) = {gUp) n \h\ p { p ) 

IGqhUp) = [Gfl P (p)®m P (p) 
\g-hUp) = {GUp)-{H\ p {p) 

l{o)G\ p (jp) = U ( E d(q)-lGU<l)) 

p^d gGsupp(ci) 

MGUP) = [I ( E d{ q )-\GUd)) 

p^d qesupp(ci) 

ipX.GUv) = Up(\f.(lG} p[f/x] ))(p) 

\vX.G\ p (p) = gfp(A/.([G], [//x] ))(p) 

where the symbols • and on the right hand side denote the operations of product and 
coproduct on [0,1], respectively. It is easy to verify that the interpretation assigned to 
every pL^ operator is monotone, thus the existence of the least and greatest fixed points 
is guaranteed by the Knaster-Tarski theorem. 

The interpretation of the connectives of the logic pL/i (and its fragment pL/i) resembles 
the corresponding ones for hp. Both operations {U, 0}, when restricted to the two element 
set {0, 1} act as ordinary boolean disjunction. Similarly, the operations {n, •} restricts to 
ordinary boolean conjunction. For what concerns the semantics associated with the modal 
operators, since in PLTS's transitions lead to probability distributions over states, rather 
than states, the most natural way to interpret the meaning of a formula G at a probability 
distribution d is to consider the expected probability of the formula G holding at a state q 
randomly drawn in accordance with d, and this is formalized by the weighted sums in the 
definition above. 

Remark 3.2. As it is common practice when dealing with fixed point logics such as the 
modal ^-calculus, we presented the syntax of pLp & in positive form, i.e., without including 
a negation operator. This simplifies the presentation of the denotational semantics because 
all formulas in positive form are interpreted as monotone functions. A negation operator 
on (closed) pL/i formulas can be defined by induction on the structure of the formula, by 
exploiting the dualities between the connectives of the logic, in such a way that [~F]]p(p) = 
1 — [F]p(p), for all formulas F and states p. We omit the routine details. 
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As anticipated in the introduction, the main reason for extending the logic pL/i with 
the new pair of connectives of product and coproduct is to get a richer and more expressive 
logic capable of encoding the qualitative threshold modalities defined as follows. 

Definition 3.3. Given a pL^ formula F, we define the macro formulas f>oF and ¥=\F 
as follows: P >0 F d = fj,X.(F X) and F =l F d = uX.(F ■ X), where X is not free in F. 

The following lemma captures the denotational semantics of the qualitative threshold 
modalities. 

Lemma 3.4. Given a PLTS C = (P,{-^} a(iL ) , a [O,l]-interpretation of the variables 
pG Var— > [0, l] p and a pL/j, G formula F, the following assertions hold: 

for every state pEP. 

Proof. The map x \— > A x, for a fixed A 6 [0, 1], has 1 as unique fixed point when A > 0, 
and as the least fixed point when A = 0. Similarly for the map x h4 A • x. The result then 
follows trivially. □ 

It is easy to verify that the derived qualitative threshold modalities, if taken as prim- 
itives, are De Morgan duals. As an immediate consequence of Lemma 13.41 we have the 
following fact. 

Proposition 3.5. The denotational interpretation of an open pL[i® formula F is, in gen- 
eral, not continuous in the free variables, i.e., the denotation of a formula, seen as a func- 
tion of type ( Var — > [0, l] p ) — > [0, l] p , where ( Var — > [0, l] p ) is ordered pointwise, does not 
preserve countable ^-increasing chains. 

Proof. Consider the formula P=iX = vY.{X ■ Y) having just one free variable X. We have 
that [P=iJr]„(p) = if p(X)(p)<l and [P =1 X]£(p) = l if p{X)(p) = l. □ 

This contrasts with the fact that the denotations of pL/i formulas (i.e., formulas without 
occurrences of (co)products operators) when interpreted over finite PLTS's, are continuous 
in the free variables (see, e.g., Appendix C of [23] for a proof of this fact, and [25} §3.3.2.3] 
for a discussion about this phenomenon). It then follows that the qualitative threshold 
modalities are not expressible in pLfi. Thus, pL^/ is a strictly more expressive logic than 
pL/i, as previously claimed. 

The following theorem summarizes some expressivity results about the logic pL/i . 
Since the focus of this paper is primarily the study of a game semantics for pL^ , we just 
refer to Theorem 7.2.16 and Proposition 7.2.5 in |25| for detailed proofs. 

Theorem 3.6. The following propositions hold. s. 

(1) the logic pL[x® can encode the qualitative fragment of the logic PCTL of [2], 

(2) there are (closed) pLfj,® formulas that can by satisfied only by infinite PLTS's. Thus 
pLfj, does not satisfy the (expected adaptation of) the finite model property, 

(3) there are (closed) pL[i® formulas satisfiable by some PLTS's but not satisfiable by any 
non-probabilistic PLTS (see Definition \2.2) . 

where a PLTS £ = (P, {— — >} a eL) satisfies a (closed) formula F, if there is some p E P such 
that {F}(p) = l. 
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4. Stochastic tree games 

In this (unavoidably long) section we introduce a new class of games which we call two- 
player stochastic tree games, or just 2^-player tree games. Stochastic tree games generalizes 
standard two-player turn-based stochastic games (see, e.g., [TJ, [8]) by allowing a new class 
of branching states on which the execution of the game in split in independent concurrent 
subgames. Formally, stochastic tree games games are infinite duration games played by 
Player 1, Player 2 and a third probabilistic agent named Nature, on a game arena A = 
((S, E), (Si, S2, Sn, B), it), where (S, E) is a directed graph with countable set of vertices S 
and transition relation E, (Si, S2, Sn, B) is a partition of S and tt:Sn—iT>(S). The states 
in Si, S2, Sn and Sb are called Player 1 states, Player 2 states, probabilistic states and 
branching states respectively. We denote with E(s), for s£S, the set {s' | (s, s') € E}. As 
a technical constraint, we require^ that supp(7r(s)) C E(s), for every s&Sjy- 

Definition 4.1 (Paths in „4). We denote with V u and V <UJ the sets of infinite and finite 
paths in A. Given a finite path s€V <u) we denote with first(s) and last(s) the first and last 
state of s, respectively. Given a finite path s and a (finite or infinite) path t we write s <3 t 
if s is a (not necessarily proper) prefix of t and, provided that first(i) Gi?(last(s)), we write 
s.t for the concatenation of the two paths. We denote with V t the set of finite paths ending 
in a terminal state, i.e., the set of paths s such that E(last(s)) = 0. Similarly, we denote 
with Vf u and the sets of finite paths ending in a state in S\ and S2, respectively. We 
denote with V the set V u U V and we refer to this set as the set of completed paths in A. 
Given a finite path sG J> <UJ ) we denote with Og the set of all completed paths having s as 
prefix. We consider the standard topology on V where the countable basis for the open sets 
is given by the clopen sets Og, for s&V <UJ . This is a 0-dimensional Polish space |25| . 

Definition 4.2 (Tree in .4). A tree in the arena A is a collection T = {si}i e j of finite paths 
SieV <UJ , such that 

(1) T is down-closed: if sGT and t < s then i€T. 

(2) T has a root: there exists exactly one finite path {s} of length one in T. The state s, 
denoted by root(T), is called the root of the tree T. 

We consider the nodes s of T as labeled by the last function. 

Definition 4.3 (Uniquely and fully branching nodes of a tree). A node s in a tree T is said 
to be uniquely branching in T if either E(\ast(s)) = or s has a unique child in T. Similarly, 
s is fully branching in T if, for every s € E(\ast(s)), it holds that s.s^T. 

An outcome of the game in A, which we call a branching play, is a possibly infinite tree 
T in A defined as follows: 

Definition 4.4 (Branching play in A). A branching play in the arena A is a tree T in A 
such that, for every node sGT the following conditions holds: 

(1) If last (5) 6 Si U 52 U Sn then s branches uniquely in T. 

(2) If last(s) (zB then s branches fully in T. 

We denote with BV the set of branching plays T in the arena A. 

^The constraint supp(7r(s)) — E(s), which might look more natural, is unnecessarily restrictive since one 
just one want to impose that Nature's choices always belong to the set of successor states. Our relaxed 
constraint will be technically convenient, see, e.g., Footnote [3] 



PROBABILISTIC MODAL ^-CALCULUS WITH INDEPENDENT PRODUCT 



11 



A branching play T represents a possible execution of the game from the state s labeling 
the root of T. The nodes of T with more than one child are all labeled with a state s € B 
and are the branching points of the game. Their children represent the many independent 
instances of play generated at the branching point. 

Definition 4.5 (Topology on BV). Given a finite tree F in A, we denote with Of Q BV 
the set of all branching plays T such that F C T. We fix the topology on BV, where the 
basis for the open sets is given by the clopen sets Op, for every branching-play prefix F. It 
is routine to show that this is a O-dimensional Polish space |25j . 

As usual when working with stochastic games, it is useful to look at the possible out- 
comes of a play up-to the behavior of Nature. In the context of standard two-player stochas- 
tic games this amounts to considering Markov chains. In our setting the following definition 
of Markov branching play is natural: 

Definition 4.6 (Markov branching play in A). A Markov branching play in A is a tree M 
in A such that for every node s£M, the following conditions hold: 

(1) If last(s) eSi U S2 then s branches uniquely in T. 

(2) If last(s) £ Sn U B then s branches fully in T. 

A Markov branching play is similar to a branching play except that probabilistic choices 
of Nature have not been resolved. 

Definition 4.7 (Probability measure Pm)- Every Markov branching play M determines a 
probability assignment Pm(Of) to every basic clopen set Of^BV, for F a finite tree in A 
(we can assume that every node s€F such that last(s)€SAr has a unique child in F, since 
otherwise Op = 0), defined as follows: 

F M (0 F ) d = [ n"M s )( s ') I s- s - s '^ F AseSV} ifFCM 
I otherwise 

Such an assignment extends, by Caratheodory's Extension Theorem [31, 25J, to a unique 
Borel probability measure on BV, whence to a complete probability measure, also denoted 
by P M . 

It is the definition above that implements the probabilistic independence of the sub- 
branching plays rooted at some branching node. 

Definition 4.8 (Two-player stochastic tree game). A two-player stochastic tree game (or 
a 2^-player tree game) is given by a pair (A,G>), where A is a stochastic tree game arena 
as described above, and <I> C BV, which is the objective or winning set for Player 1, is a 
universally measurable set of branching plays in A. 

Definition 4.9 (Expected value of a Markov branching play). Let (A,$) be a 2^-player 
tree game, and M a Markov branching play in A. We define the expected value of M as 
follows: E(M) = The value E(M) should be understood as the probability for 

Player 1 to win the probabilistic play represented by M. 

As usual in game theory, players' moves are determined by strategies. 

Definition 4.10 (Deterministic strategies). An (unbounded memory deterministic) strat- 
egy o"i for Player 1 in A is defined as a function a± :V^ — T-S'Uj*} such that 01 (s) £ i?(last(s)) 
if E(\ast(s)) 7^ and o~i(s) = » otherwise. Similarly a strategy o<i for Player 2 is defined as 
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a function a% : — > S U {•}. A pair (ai, 02) of strategies, one for each player, is called a 
strategy profile and determines the behaviors of both players. 

Note that the above definition of strategy captures the intended behavior of the game: 
both players, when acting on a given instance of the game, know all the history of the 
actions happened on that subgame, but have no knowledge of the evolution of the other 
independent parallel subgames. 

Definition 4.11 (M%° ). Given an initial state so € S and a strategy profile (01, 02) a 
unique Markov branching play M§.° U2 is determined: 

(1) the root of M is labeled with so, 

(2) for every sG Mj!° CT2 , if last(s) = s with s G Si not a terminal state, then the unique child 
of sin M*j )CT2 isk(0!(s)), ^ 

(3) for every sG M%° a , if last(s) = s with s £ S2 not a terminal state, then the unique child 
of smMp^ is's.(0 2 (s)). 

This specifies uniquely CT2 because Markov branching plays branch fully on probabilistic 
and branching states. 

Definition 4.12 (Upper and lower values of a 2^-player tree game). Let Q = (.4, $) be a 
2 ^-player tree game. We define the lower and upper values of Q on the state s, denoted by 
VALJ(^) and VAL|(C?) respectively, as follows: 

VALJ(S) = U CTi n CT E(M* li(72 ) VAI4«?) = I I (j 2 U CT1 E(M^ i(T2 ) 

VAL|(£/) represents the limit probability of Player 1 winning, when the game begins at 
■s, by choosing his strategy o~\ first and then letting Player 2 pick an appropriate counter 
strategy 02. Similarly VAL^(^) represents the limit probability of Player 1 winning, when 
the game begins at s, by first letting Player 2 choose a strategy 02 and then picking 
an appropriate counter strategy a\. Clearly, for every s, the following inequality holds: 
VALJ(C/) < VAL|(^). In the special case (not true in general) that this inequality is an 
equality, we say that the game Q is determined at s. 

Definition 4.13 (e-optimal strategies). Let Q = (A, <£) be a 2^-player tree game. We say 
that a strategy 01 for Player 1 in Q is e-optimal, for e>0, if for every state s, the following 
inequality holds: 

n CT E(MJ ij(T2 )>VALf(S)- e . 

Similarly we say that a deterministic strategy 2 for Player 2 in Q is e-optimal, for e>0, if 
for every state s, the following inequality holds: 

U CTl E(M^ CT2 )<VALf(S) + £ . 

Clearly e-optimal (mixed and deterministic) strategies for Player 1 and Player 2 always 
exist for every e>0, but not necessarily so for e = 0. 

Remark 4.14. Observe that a 2^-player tree game without branching states is just an 
ordinary two-player turn-based stochastic game (see, e.g., [5], |25j): the set of branching 
plays is homeomorphic to the set of completed paths, the notion of Markov branching play 
collapses to the standard notion of Markov chain, and strategies are maps from finite paths 
to successor states. Thus, as previously claimed, two-player stochastic tree games constitute 
a generalization of ordinary two-player stochastic games. 
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Notwithstanding our primary interest in an appropriate game semantics for pL/i®, we 
highlighting here that the simple form of partial information implemented in tree games 
(players when acting on a given subgame are not aware of what happens in the other 
independent subgames) is surprisingly powerful. For instance the class of Blackwell games 
[31 [21] can be encoded as two-players tree games (Theorem 4.2.18 in [25J). Moreover, 
interesting open problems in the field, such as that of qualitative determinacy of stochastic 
games (see, e.g., [6]), can be formulated as appropriate determinacy problems for 2-player 
tree games (see, |25|, §4.4]). We refer to the author's PhD thesis [25] for an extensive 
introduction and analysis of tree games. 

4.1. Two-player stochastic meta-parity games. In this subsection we identify a class 
of two-player stochastic tree games, called 2^-player meta-parity games, which will be used 
to give an appropriate game semantics to the logic pL/i®. 

A 2^-player meta-parity game is a 2^-player tree game Q = (A, 3>), which we refer to as 
the outer game, in which every branching play T is itself interpreted as a (ordinary) two- 
player parity game Gt, which we refer to as the inner game associated with T, and whose 
objective is defined as the set of branching plays T for which Player 1 has a winning 
strategy in Gt- 

We start formalizing this notion with the following definitions. 

Definition 4.15. A parity assignment for a two-player stochastic tree game arena A = 
((S,E), (Si, S2, Sn, B), 7r) is a function Q, : S — > N whose image is finite. In other words 

assigns to each state s £ S a natural number, also referred to as a priority, taken from 
a finite pool of options {no, n^} = f2(S). We denote with max(J)), min(f]) and |0| the 
natural numbers max{rao, ...,n&}, minjno, n^} and \{no, n&}| respectively. 

The function £1 induces a set of completed paths, denoted by Wo, specified as follows. 

Definition 4.16. Let A= ((S, E), (Si, S2, Sat, B), it) be a 2^-player tree game arena and 
f2 a parity assignment for it. A completed path s belong to the parity set induced by £1, 
denoted by Wn^V, if either: 

(1) s is a finite terminated path, i.e., s&V 1 , and the priority assigned to the last state of s 
is odd, i.e., 0(last(s))=l (mod 2), or 

(2) s is infinite, i.e., sGT"^ with s = {sj}j g N, and the greatest priority assigned to infinitely 
many states Sj in s is even, i.e., (limsupfi(sj)) =0 (mod 2). 

It is well known (see, e.g., [7]) that Wn is a A3 set, hence a Borel set. 

Definition 4.17. A player assignment PI for a two-player stochastic tree game arena A = 
((S, E), (Si, S2, Sat, B),tt) is a function PI : B — > {1, 2}. We often include the information 
provided by PI directly in the signature of A by considering the partition (Si, S2, Sat, B\,B2), 
where B i = P\~ 1 ({i}), for ie{l,2}. 

The function PI assigns a player identifier to each state s£B. This allows to consider 
each branching play T in A as a parity game Gt (induced by Q and PI) played by Player 

1 and Player 2 on the tree T, where Player 1 and Player 2 controls the vertices s of T such 
that Pl(last(s)) = 1 and Pl(last(s)) = 2 respectively. All other vertices are either leaves, in 
which case the game Gt ends, or have a unique child, towards which the game automatically 
progresses. The result of the game is a branch in T or, equivalently, a completed path in 
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A. Adopting standard terminology (see, e.g., [20], [3D]), we say that Player 1 (respectively 
Player 2) wins the parity game Gt if they have a winning strategy guaranteeing the outcome 
of the game to be in the set Wn (respectively, in V \ WpJ. It is well known (see, e.g., [20J ) , 
that one of the two player has a winning strategy in Gt- 

We are now ready to formally introduce the notion of 2^-player meta-parity game. 

Definition 4.18. Given a 2^-player tree game arena, a priority assignment $7 and a player 
assignment PI for it, the associated two-player stochastic meta-parity game is defined as the 
2 ^-player tree game Q=(A, 3>n,pi), where <&n,p\^BV is defined as follows: 

&n,p\ = {T | T G BV and Player 1 has a winning strategy in Gt}- 
Note that, by previous observations, the set BV \ $0^1 can be specified as follows: 

BV \ <&n,p\ = {T I T G BV and Player 2 has a winning strategy in Gt}- 
We often just write <& if the priority and player assignments are clear from the context. 

Remark 4.19. Note that a 2^-player meta-parity game Q = {A, <&n,p\) without branching 
states is just an ordinary 2^-player game. The game Gt associated with a branching play 
T (which is just a completed path s, see Remark I4.14|) is trivial, and belongs to $n,Pi if 
and only if sG Wn- Thus 2^-player meta-parity games generalize ordinary 2^-player parity 
games in an obvious way. 

Note that Definition 14.181 is meaningful, in accordance with Definition 14.81 only if the 
set &n t p\ is a universally measurable set of branching plays. As we now discuss, this turns 
out to be a delicate point. 

Theorem 4.20. Given a 2^-player tree game arena A, a priority assignment f2 and a 
player assignment PI for it, the associated set <3?n,Pl of branching plays is a A2 set. 

Proof. Let us denote with Vg u the set of finite paths s£ V <UJ in A such that last(s) 6 B 
and Pl(last(s)) =i, for % G {1, 2}. Let us consider the set Ej of functions Vj£ ^V <ul U{m}. 
This set contains all the strategies available to Player i in every game Gt, for TgBV, seen 
as functions / G Ej restricted to T. We endow E, with the Baire space-like topology, where 
for every pair (x,y), with x G and y G V <U) L){»}, the set O x>y of all functions / G Sj 
such that f(x) = y is a basic open set. This is a 0-dimensional Polish space. 

Let us now consider the subset of BV x Si x S2, denoted by T, consisting of all triples 
(T, 01,0-2) such that the strategies o~\ and 02 are valid strategies in Qt, i.e., functions from 
finite sequences of vertices in T to vertices in T. It is easy to see that T is a closed subset 
of BV x Si x £2 (endowed with the product topology). Indeed, the set of triples which 
do not belong to T is open, because one can tell if one of the two strategies o\ and 02 is 
not valid in the inner game Qt, i.e., it makes choices which are not in T, just by looking at 
finite information about T, o~\ and 02. Hence T is a Polish space, as it is a closed subset of 
the Polish space BV x Ei x E 2 . 

Let us denote with out : T — > V the function which maps a triple (T, 01,(72) to the 
induced play (i.e., a completed path in A) in Qt- The function out is clearly continuous. 

Let us now consider the set AC-T defined as the set of triples (T, o~i, 02) such that the 
game Gt is won by Player 2 when the two players follow the (valid for Qt) strategies o~\ and 
£72 respectively, i.e., the set formally defined as A = out~ l (V \ Wq). Since out is continuous 
and Wo is a Borel set, it follows that A is a Borel set. 

Let us now define the set B C BV x Si as B = {(T, o~x) \ 3o~2 G S2-(T, cr\, 0-2) G ^4}. The 
set B is the set of all pairs (T, o\ ) , such that Player 2 has a strategy 02 in the game Qt 



PROBABILISTIC MODAL ^-CALCULUS WITH INDEPENDENT PRODUCT 



15 



winning against a%, i.e., such that the strategy profile (<7i,<72) induces in Qt a completed 
path in V\ Wq. The set B is a Yj\ set by construction. Observe that its complement B 
is the set of all pairs (T, o\ ) such that Player 2 does not have a strategy a 2 for the game 
Qt winning against the strategy o\. Equivalently, by determinacy of 2-player parity games 
[20] . the strategy o~\ is a winning strategy for Player 1 in the game Qt- The set B is a II J 
set by construction. We can now define the set $n t pi C BV of all branching plays T where 
Player 1 has a winning strategy in Qt as &n,p\ = {T | 3o"i G Ei.(T, a\) EB}. It then follows 
that, by construction, Qq : p\ is a H,\ set. 

The desired result then follows by observing that the complement set $n,Pi is also a Jl\ 
set. This is because ^n,p\ is the winning set associated with the triplet (A, f2, PI), where Q is 
the dual parity assignment defined as Q(s) = Q(s) + 1, and f2 is the dual player assignment 
inverting the role of the two players, specified as PI (6) = if and only if Pl(6) = l. Q 

The following theorem asserts that the result of Theorem 14.201 is strict. Thus the 
technologies employed in this paper for dealing with the complexity of the winnings sets in 
2 ^-player meta-parity games are not trivially avoidable. Since the technicalities required 
for proving the result would not be particularly useful for the main theorem of this paper, 
we just provide a reference to a detailed proof. 

Theorem 4.21. There exists a 2^-player meta-parity game Q = (A, $r2,Pi)> having a finite 
arena A, such that the winning set §n,p\ is not analytic nor co-analytic, i.e., $n,Pi ^SjunJ. 

Proof. One can construct an explicit example of finite 2 ^-player meta-parity game and show 
that both a Xj-complete set and a IlJ-complete set are Wadge-reducible to the winning set 
PI. We refer to Theorem 6.4.3 in [25] for a detailed proof. □ 

It follows that, absent any further evidence, the winning set of a 2^-player meta-parity 
game might be not provably universally measurable in ZFC set theory. However, as stated 
in Theorem 12.101 it is provably universally measurable in ZFC + MA^ 1 set theory. This is 
one of the uses we make of Martin's axiom at but, as we shall note later in Section [8.11 
not the only one. 

The following theorem, which will be useful later, exposes an important property of 
2 ^-player meta-parity games and sheds some light on the relationship between this class of 
games and the logic pL^®. It constitutes the expected generalization of the corresponding 
property of ordinary 2^-player parity games (see, e.g., Proposition 4.19 in [26]). 

Theorem 4.22. Let Q= {A, $n,pi) be a two-player stochastic parity game with arena A = 
((S,E),(Si,S 2 ,S n ,B 1 ,B 2 ),tt), where Bi = Pr l {{i}). The functions VM^Q) andVM^Q), 
of type S — > [0, 1], are fixed points of the functional T : [0, l] s — > [0, l] s defined as follows: 
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Proof. The proof is carried out following the same methodology of, e.g., Proposition 4.19 
in [26] . The interesting cases are associated with the analysis of the branching nodes s€Bi 
and s€B2- In what follows we just show that, for every s(zB\, the following equality holds: 

VAL^(g)( s )>u teE(s) VAL 4 (g)(t). 

The reverse inequality VAL|(t/)(s) < ]j t6£ v s ) VALj, (£?)(£), as well as all other cases for s € 
{Si, S2, 5V -62} can be proved in a similar way. We refer to Theorem 5.2.10 of [25] for a 
detailed proof covering all cases. 

By Definition 032] of VAL|.(£), we need to prove that the equality \~\ a2 E(M* lj(T2 ) > 
ILe£(s) (Un lira E (^ri,r 2 )) holds. Let E(s) = {U} ie i. At the state s the game is split 
in /-many subplays continuing their execution from the states £j. Let rj be a ej-optimal 
strategy (see Definition 14. 13|) for Player 1, with Ei>0. 

Define the strategy o~\ for Player 1, when the game starts at s and the /-many subplays 
are generated, to behave in the subplay continuing its execution from ti as the strategy t\. 
Given any strategy 02 for Player 2, the Markov branching play CT2 can be depicted^ as 
follows: 




where, for each i £ I, the strategy r\ is specified as T\{tj) = <7 2 (s.fj) for all finite paths ti 
with first(ij) = ti. Let us denote, to improve readability, with M and Mi, for i £ I, the 
Markov branching plays and M * i7 respectively. We are now going to show that 

T 1' T 2 

the following equality holds: 

PM(*n,pi) = II p M i (*n,pi) (4.1) 

iei 



The edge connecting s with ti has not been dashed to highlight that s is a branching node. 
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holds. This will conclude the proof. Indeed note that, by construction of a\, the inequality 
PAfi(^n,Pl) — VAL^(^)(<j) — £j holds. Thus, the strategy o\ guarantees, by appropriate 
choices of values £«, for i €/, a value closed to VAL|(C7)(^) as desired. 

iei 

For what concerns Pm, we can restrict attention to the set of branching plays BV S , 
where BV S denotes the set of branching plays in A rooted at s, since the set of all other 
branching plays in Q gets assigned probability by Definition 14.71 of Pm ■ Similarly, when 
considering Pjv^, we can restrict to the set BVi of branching plays rooted at ij. We can 
depict the branching plays in BV S and the branching plays in BVi as follows: 




where we use Ti to range over the set of branching plays in Q rooted at ti. We denote 
with s[Ti]i € j the branching play on the left. Let WiBVi be endowed with the product 
topology. Define m : Wi BVi — > BV S as m({Ti}i^i) = s[Tj]j g /. It is easy to verify that m is 
a homeomorphism. Consider the product measure Xjg/Pjv^ on the space WiBVi. We now 
show that the equality 

x ie/ P M .(X)=P M (m(X)) (4.2) 

holds for every measurable X C WiBVi. By regularity of measures in Polish spaces (see, 
e.g., [T7]). we just need to prove that for each basic open set O C \\ { BVi the equality 
x ie jF M i(0) = Pm("i(0)) holds. The basic sets O in the product topology are of the form 
Op x ... x Op k x Y[i>k B'Pi w ^ n ®F n ^BVn, for some /cGN and < n < k. As usual, Op n 
denotes the basic open set of branching plays containing the finite tree F n . Equality 14.21 
then follows by definition of m and Definition 14.71 of the probability measures Pm and Pm; • 
The validity of Equation 14.11 is then derived as follows: 

PA/($n,pi) =a P M (^n ,p\nBV s ) 

=b PAf(m(n <eJ (gn, PingP<))) 

= c i-P M H n i£ j($a,pin gn))) 
1- x ieI V M .(9 a ,p\nBPi) 
1_ H(l -F Mi (®n,p\ n BVi)) 



=D 
=E 



=F 
=G 



i-n(i-p Ml (^, P i)) 

iei 

U p «i(*n,pi). 

ie/ 



where the overlined sets denote the expected complements. Steps (A) and (F) hold by 
previous observations. To justify step (B), observe (using a standard strategy stealing 
argument) that a branching play s[Tj]j e j is winning for Player 1 (i.e., it is in ^n^i) if and 
only if at least one of its subtrees Ti is winning for Player 1. This is because the state 
s € B\ is under the control of Player 1 in the inner game. Step C is valid because m 
is a homeomorphism, thus a bijection. Step (D) holds by Equation 14.21 Step E holds 
by definition of product measure. Lastly, step (G) holds by De Morgan dualities of the 
operations of product and coproduct. □ 
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We conclude this section by remarking that the notion of 2^-player meta-parity game 
can be further generalized, allowing the inner games to be 2-player games with general Borel 
winning sets. We refer to [25\ §5] for an analysis of this sort of games. 

5. Game semantics of pL/x® 

In this section we define the game semantics of the logic pL/x®. As for L/x [30J and pL/x 
[231 [26], given a PLTS (P, {—>} a <zL) and an interpretation of the variables p a game Qp is 
constructed for every pL/x® formula F. The game semantics of a formula F at a state p is 
defined as the value of the game at a designated state (p,F). The logics L/x and pL/x are 
interpreted using ordinary 2-player parity games and 2^-player parity games, respectively. 
As anticipated earlier, we shall interpret pL/x® with the novel class of 2^-player meta-parity 
games. Following the approach of [30], we first identify a class of pL/x® formulas which is 
easier to work with and allow the simplification of some definitions. 

Definition 5.1 (|30j). We say that a pL/x® formula F is in normal form, if every occurrence 
of a p or v binder binds a distinct variable, and no variable appears both free and bound. 
Every formula can be put in normal form by standard a-renaming of the bound variables. 

Definition 5.2 (|30j). Given a pL/x® formula F in normal form, we say that a variable X 
subsumes a variable Y if X and Y are bound in F by the subformulas *\X.G and ^Y.H 
respectively, and *2Y.H € Sub(G), for *i,*2&{^, l/ }- 

Definition 5.3. We say that a pLii® formula F is in product normal form if 

(1) it is in normal form, and 

(2) it does not contain subformulas of the form G ■ G or G G. 

Every formula can be put in product normal form by (recursively) replacing every subfor- 
mula G * G with, e.g., the semantically equivalent formula G * (G V G), for *G {•, 0}. 

In what follows we shall restrict our attention, without loss of generality, to formulas in 
product normal form. While the advantage of restricting to normal formulas is clear |30| . the 
product normal form is useful for the following reason. As anticipated in the introduction, 
we shall interpret game-states of the form (p, F ■ G) and {p, F G) as branching states 
having the states (p, F) and (p, G) as children. When F = G, the set of children becomes a 
singleton, and this does not reflect the intended game interpretation. The product normal 
form is one of the simplest way to avoid this kind of situations. As an alternative solution, 
one might consider multisets of successor states, rather than sets, in the definition of 2~ 
player meta-parity games. 

We are now ready to specify how, given a PLTS C=(P, {-^}aei}, the 2^-player meta- 
parity game Qp = {A, $f2,Pl), associated with a pLii® formula F and a [0, 1] -interpretation 
p of the variables, is constructed. 

The game arena A = ((S, E), (Si, S2, <SW, B),n) is defined as follows. The set of game 

states S is defined as S d = (PxSub(F)) U (V(£)xSub(F)) U {T, _L}, where V(C) denotes 
the (countable) set of probability distribution in C (see Definition 12. 2p . and {T, _L} are two 
special states representing immediate win and loss for Player 1, respectively. The relation 

E is defined as follows: E((d,G)) = f {(p, G) \ p € supp(d)} for every d € T>{C). The set 
E((p, G)) is defined, by case analysis on the outermost connective of G, as follows: 
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(1) if G=X, with X free in F, then E({p, G)) = {_L, T}. 

(2) if G=X, with X bound in F by the subformula *X.H, with ★ € {p, v}, then £7((p, G)) = f 
{(P,H)}. 

(3) if G = *X.H, with *e{//,i/}, then £((p,G)) d = {(p,F)}. 

(4) ifG=(o)fr, then £((p, G)) d = {((i, F) | p d}. 

(5) if G=[a]H, then E({p,G)) = {{d,H) \p^d}. 

(6) if G = H * #' with * G {V, A, 0, ■} then E((p, G)) = {(p, H), (p, f/ 7 )} 

Lastly we define T and _L to be terminal states, i.e., E(l) = E(T) = 0. The partition 
(Si, S2, Sn, B) of S is defined as follows: every state (p,G) with G's main connective in 
{(a), V, pX} or with G = X where X is a /u-variable, is in £1. Dually, every state (p, G) with 
G's main connective in {[a] , A, vX} or with G = X where X is a z^-variable, is in S^- Every 
state of the form (d, G) or (p, X), with X free in F, is in Sn- Every state (p, G) whose G's 
main connective is either • or is in B. Lastly we define the terminal states _L and T to be 
in Si and £2 respectively. The function it : Sn —}V(S) assigns a probability distribution to 
every state under the control of Nature (thus specifying its indended probabilistic behavior) 
and it is defined as ir({d,G))({p,G}) = d(p) on all states of the form (d,G). All other states 
in Sn are of the form (p,X), with X free in F. The function it is defined on these states 
as follows: 

r p(x)( P ) if s = t 

n((p,X))( S ) d ^ I l-p(X)(p) if s = ± 
I otherwise 
The priority assignment f2 : S — > N is defined as usual in ^-calculus games: an odd priority 
is assigned to the states (p,X) with X a [i- variable and, dually, an even priority is assigned 
to the states (p, X) with X a z^-variable, in such a way that if Z subsumes Y in F then 
il((p, Z)) > $7((p, y}). Moreover, for every terminal state s £ S 1 , we define = if 
s G Si, and Q(s) = 1 if s G S2. This implements the policy that a player who gets stuck 
at a terminal state loses (see Theorem I4.22D . All other states get assigned, by convention, 
priority 0. Lastly, the player assignment PI :B— 2} is defined as Pl((p, G1QG2}) = 1 and 
PI((p,G r G 2 })=2, for every peP and G x ,G 2 eSub(F). 

Remark 5.4. We now list some useful observations about the above defined game Qp. 

(1) If no (co)product operators occur in F, then B = 0, and the game Gp is equivalent 
to the pL/i games of [531 US] ( see Remark 14. 19[) . Thus the game semantics for pL// 
generalizes the game semantics of pL/i, as previous claimed. 

(2) If the PLTS £ is finite then the game arena A of Qp is finite too. 

(3) Note how the only role of two game states {T, _L} is to interpret the game states (p, X) 
with X a free variable. By application of Theorem 14. 22\ it follows that the game values 
at T, _L and (p, X) are 1, 0, and p(X)(p) respectively, as expected. This solution avoid 
the otherwise necessary introduction of [0, l]-valued payoff functions in the definition of 
2^-player meta-parity games. 

We are now ready to state our main result. 

Theorem 5.5 (MA^ 1 ). Given a PLTS £ = (P,{—^} a ^i), for every statep^P, interpre- 
tation of the variables p and pLp® formula F , the following equalities hold: 

VAU(^)((p,F)) =VALt(^)((p,F» = lF} p (p). 
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Note that Theorem 15.51 asserts that pL^ games are determined. In light of this result, 
we can just write \//KL(G F ) for the unique value function of the game G F ■ The game 
semantics of F at p under the interpretation p is then defined as \/Al(G F )((p, F)), and it 
coincides with the denotational semantics as desired. 

The game semantics for pL// offers a clear and simple operational interpretation for 
the meaning of the qualitative threshold modalities P>o and P = x (see Definition I3.3p . Let 
us consider, for example, the game G P >0 associated with a PLTS C = (P, { — >} a eL), a 

[0, ^-interpretation p and the pL/i formula P>o-F = f pX.(F X). The game Gp >oF , at the 
state {p, pX.(F X)), for some p€ P, can be depicted as follows: 



(P,F) S -(p,X) 




(P,FQX) 



(p,nX.(FQX)) 



After an initial unfolding step from (p, pX.(F X)) to {p, F X), the game is split in two 
concurrent sub-games, one continuing its execution from the state (p, F) (this sub-game 
can be considered an instance of the game G F starting at (p,F)) and the other from the 

state (p,X). In order to win the game G^> >oF , Player 1 has to win in at least one of the 
two generated sub-games, thus either in the instance of Gp or in the sub-games continuing 
at (p,X). This second sub-game, however, after an unfolding step, progresses to the game 
state {p,FQX), where the protocol is repeated generating yet another two sub-games. The 
infinite execution of the game leads to the generation of infinitely many instances of the 
game Gp . A branching play T in Gp >oF can be depicted as follows: 



\ / 
\ / 
\ / 
\ / 



I 2 

(p,F) h,X) 
jl (p,FQX) 
(p,F) (p,X) 

(p,F&X) 
(p,pX.(FQX)) 

where Ti, T2, . . . , represent the branching plays corresponding to the plays in each generated 
instance of the game G F ■ Since the variable X unfolded infinitely often in the rightmost 
path in T is bound by a least fixed point in pX.(F X), and since the nodes are Player 
1 choices in the inner game Gt, we have that T is a winning branching play for Player 1 if 
and only if there exists some n€N such that T n , the outcome of the n-th generated instance 
of G(F,p), is winning for Player 1. Thus, the game Gj >oF , at the state (p,pX.F X) can 
be simply described as follows: generate an infinite number of instances of the game G F at 
the state {p,F); Player 1 wins if at least one of the infinitely many generated instances of 
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Qp ends up in a winning branching play and Player 2 wins otherwise. It is then quite clear 

that if VAL(gp >oF )((p,P >0 F))>0 (or, equivalently, lF} p (p)>0 by Theorem EE} , then the 
probability that at least one (and in fact countably many) of the infinitely many instances 
of Qp will result in a win for Player 1, is 1. Similarly, if [-F]p(f>) = 0, then the probability 
that at least one of the instances of Q F will result in a win for Player 1, is 0. 

The game semantics for pL^i® thus offers a straightforward interpretation for the prob- 
abilistic qualitative modality P>o exploiting the simple idea that an event (which we can, 
at some extent, see as a pLjU® property) has probability greater than zero if and only if, 
when repeated infinitely many time, it almost surely occurs at least once. An analogous 
straightforward interpretation can be given to the other qualitative threshold modality 

¥ = \F = f vX.(F ■ X): generate an infinite number of instances of the game Qp at the state 
(p,F); Player 1 wins if all of them end up in a winning branching play for Player 1, and 
Player 2 wins otherwise. 



6. Inductive characterization of the winning set of Qp X ' F 

In this section we provide a transfinite inductive characterization of the set ^ XF of winning 
branching plays of the game Qp X ' F , for an arbitrary pL/i® formula F and interpretation 
p. This result will be used in the proof of our main result, in Section [SJ The inductive 
characterization of ^ XF will be obtained exploiting the similarities between the pL^® 
games Qp X ' F and the simpler (in the complexity of the formula) game Q F . The game 
arenas of the two games, denoted here by A^ and A F , are almost identical as they differ 
only in the following aspects: 

(1) The set of game states of A^ X ' F is the set of states of A F plus the set of states of the 
form (p,pX.F). The latter states, however, play almost no role in the game because 
they have only one successor, namely (p,F), and are not reachable by any other state. 

(2) More importantly, the states of the form (p,X), which are present in both game arenas, 
are Player 1 states in Gp X ' F (with (p,F) as unique successor), and Nature states in 
Qp (with twc@ terminal successors, T and _L, reachable with probability p(X)(p) and 
1— p(X)(p), respectively). 

Moreover observe that the player assignments of the two games, denoted here by P\ F and 
p|/iX.F^ are identical, and that the priority assignments, F and ^ X ' F , differ only on the 
game-states s of the form (p,X): Q F (s) = and £l llX ' F (s) =p for some odd (maximal) 
priority p=max(Q fM ) (see Definition 14. 15|) . 

A branching play T in the game Q F , rooted at the game state (p,F), can be depicted 
as in figure 3(a) The triangle represent^ the set of paths in T never reaching a state of 



the form (q,X), for q E P, and the other edges represents the (possibly empty) collection 
of paths {si}i£i in T, for some countable index set /, reaching a state of the form (j>i,X) 
which is (necessarily) followed by a terminal state bi € {T, _L}. Similarly a branching play 



Note that the set of successor state of (p, X)) is defined to be {T, _L}, even when p(X)(p) £ {0, 1}. 
^The picture is quite simplistic. For example there are, in general, paths in T never reaching a state of 
the form (q,X), that nonetheless branch away from the paths Si , for somewhere between the root (p, F) 
and the last state (pi,X), whereas the picture depicts all such branches as branching away immediately at 
the root (p, F) . 
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Figure 3: Branching plays and pre-plays 



T in Qp ' , rooted at (p,F), can be depicted as in figure |3(b)| We extract the common 
part between the branching plays of Qp and Qp X ' F by the following definition. 

Definition 6.1 (Branching pre-play). Let T be a branching play in Qp or in Qp X ' F , and 
{si}i£i be the /-indexed set of paths in T reaching a state of the form (pi,X), as described 



above. The branching pre-play T[xj]j g /, which can be depicted as in figure 3(c) , is the tree 



obtained from the branching play T by pruning its subtrees rooted at Sj, for 

The notation adopted for branching pre-plays is motivated by the use we make of 
them. We consider a branching pre-play T[xj]j g / as a context on which we can plug in 
other branching plays: at the hole indexed by i, for i & I, any branching play rooted at 
(p-i,X) can be plugged. If we desire to obtain a branching play for the game Qp, we shall 
fill the branching pre-play T[xi]i^j with branching plays Tj rooted at (pi,X) in A F . These 
are trees ending immediately either in the leaf T or in the leaf _L. We denote with T[&j]j 6 j 
the branching play in Qp obtained by filling the hole indexed by i with the branching play 



rooted at (pi,X) and having bi as leaf, for 6jG{T,_L} (see Figure 3(a)). Similarly given a 
/-indexed family {Tj}j g / of branching plays in Q^ x - F \ where each is rooted in (pi,X), we 
denote with T[Tj]j g / the branching play in Qp X ' F obtained by filling the hole indexed by i 



with the branching play Tj (see Figure 3(b) ) 



Clearly every branching play T in Q~J , rooted at (p,F), is uniquely of the form T[bi]i & j 
for an appropriate sequence Similarly every branching play T rooted at {p, F) in 

Qp X ' F is of the form T[Ti]i € j for an appropriate sequence {Tj}j G /. We now exploit these 
observations to define the following function from branching plays in Qp ' to branching 
plays in Qp . 

Definition 6.2. Let X C BV^ X ' F be a set of branching plays in the game Qp X ' F . We define 
the function mx :BV^ X ' F ^BV F , from branching plays in Qp X ' F to branching plays in Qp , 
as follows: 

def f T if Ti G X 



m x (T[T i ] je/ ) = TlT.eX}^ where T^X 



_L otherwise 
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Thus, the function mx maps a branching play (uniquely expressible as T[Tj]j g /, as 
observed above) to the corresponding branching play T[6j]j g / in Q F obtained by filling the 
i-th hole of T[xj]j g /, with the branching play having T as leaf if and only if belongs to 
the set X. 

Lemma 6.3. Let XCBV J ' X F be an open (Borel, universally measurable) set of branching 
plays in the game Qp X ' F . Then the function mx is continuous (Borel measurable, univer- 
sally measurable). 

Proof. It is clear that the function \T.(T<EX) of Definition [lO] is continuous (Borel, univer- 
sally measurable) precisely when X is open (Borel, universally measurable), where {T, _L} is 
endowed with the discrete topology. The proof is then carried out with standard arguments 
(see, e.g., Theorem 6.2.18 in |25j). Here we omit the routine details. □ 

We are now ready to define the operator of which ^ X - F ^ the winning set of the game 
Gp X ' F , is the least fixed point. 

Definition 6.4. The operator W: BV' jX - F BT» J ' X - F is defined as follows: 

W(X) d ^ m x \<S> F ) = {T[T,] 4e/ | T[TieX] ieI G <S> F } 
where & F is the winning set of the game Q F . 

We now prove a few important properties of the operator W. 

Lemma 6.5. If X is a set of branching plays winning for Player 1 in Qp X ' F , i.e., if 
X c $» XF , then W(X) C ^ X F too. 

Proof. Fix some X C ^ X F and consider an arbitrary branching play T\ = T[Ti] GW(X). 
It follows by definition of W that T 2 = T[Ti£X] ieI G i.e., T 2 is a winning branching play 
in the game Q F . Equivalently, Player 1 has a winning strategy a in the inner game Gt 2 
(see Section [4. ip . We now prove that Ti£<&^ x,F ', i.e., that Player 1 has a winning strategy 
r in the inner game Gt x (see Section [4.ip by a strategy stealing argument, exploiting the 
common structure (the branching pre-play T[xj\i^i) of the two branching plays T\ and 
T%. The strategy r behaves as the strategy a until a hole Si, for i (E I, is reached. Thus 
if no hole is ever reached, the plays in the two games are identical, hence Player 1 wins 
following r, as desired. If a hole s*j G / is reached, then it is necessarily the case that Tj G X, 
because otherwise the play in Gt 2 would end in the losing state _L = TjGX while playing in 
accordance with the winning strategy a. A contradiction. We then define the strategy r to 
play the rest of the game as a winning strategy Tj for the inner game Qt { ■ Note that such a 
strategy exist because T,£ J C ^ X F . It then follows that Player 1, playing in accordance 
with r, always produces a play with a winning tail. Thus, r is winning, as desired. □ 

Lemma 6.6. The operator W is monotone, i.e., W(I)CW(F) holds for every X QY . 

Proof. Fixicyc BV^ X - F . Assume T x = T[Ti] ieI G W(X), i.e., T[TiEX] ieI G <S> F . We 
need to prove that T\ G W(y) too, i.e., that T 2 = T[Ti£Y] ieI G Equivalently, we need 
to show that if Player 1 has a winning strategy in the inner game Gt x associated with T\ , 
then they have a winning strategy in Gt 2 too. The two parity games Gtx and Gt 2 are 
almost identical, except that a play ending in one of the holes Si, for iG/, might be losing 
for Player 1 in Gtx (when the game ends in the leaf _L = TjG X) but winning in Gt 2 (when 
Ti& = T). The desired result then trivially follows. □ 
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As a consequence, by application of the Knaster-Tarski theorem, the operator W has 
a least fixed point lfp(W). We are now ready to prove the main result of this section. 

Theorem 6.7. The following equality holds: ^ X - F = lfp(W). 

Proof. We already know, by application of Lemma [6.51 that lfp(W) C <&^ XF . We now prove 
that the equality holds by showing that, for every T lfp(W), the branching play T does 
not belong to <&^ XF . Fix an arbitrary T^lfp(W). We show that T^$^ by constructing 
a winning strategy a F for Player 2 in the inner game Gt- By assumption we have that 
T = T[Ti\ ieI ^lfp(W) or, equivalents, T[I-elfp(W)] ie / £ $ F . For notational convenience, 
let us denote with R the branching play T[TjGlfp(W)]j g / in Q F . Let be a strategy 
winning for Player 2 in the inner game Gr. As already done in the proof of Lemma [6. 51 we 
define a F exploiting the common structure (the branching pre-play T[xi]i^i) of T and R. 
The strategy a F behaves as the strategy until a hole for iEl, is reached. Thus if no 
hole is ever reached, the plays in the two games are identical, hence Player 2 wins following 
<rj, as desired. If a hole Si € I is reached, then it is necessarily the case that Tj gdfp(W), 
because otherwise the play in Gr would end in the state T = Tj€lfp(W), which is winning 
for Player 1, while playing in accordance with the winning strategy a^- A contradiction. 
We then define the strategy a F to play the rest of the game (forgetting the previous history) 
as the strategy crj% constructed as for cnf, but with respect to the branching play Tj. We 
shall call this a re-starting point of the play. We now prove that the strategy is winning 
for Player 2 as desired. There are two cases to consider. A play in the game Qt played in 
accordance with can have, 

(1) either finitely many restarting points, or 

(2) infinitely many restarting points, i.e., infinitely many occurrences of states of the form 
(pi,X), for iel. 

In the first case, following earlier observations, the resulting path has a winning tail and 
thus is winning. In the second case, since the states of the form (pi,X) are assigned maximal 
odd priority in Qp X ' F , the play is winning for Player 2 (see Definition I4.16p . □ 

The following results will be used for dealing with the measure-theoretic complications 
associated with the complexity of the winning set ^^ XF . 

Lemma 6.8. The least fixed point ofW is reached in at mostu)\ iterations, i.e., the equality 
lfp(W) = U a<Wl W a holds, where W a = \Jp <a W(Wp). 

Proof. Assume T[Ti] ieI G W^+i or, equivalently, T[TjGW Wl ] E <fr F . Let J = {i \ T t GW Wl }. 
For each j € J, let f3j be the least ordinal such that Tj € . Note that (3j is a countable 
ordinal, since W W1 = \J a<ull W a , and uj\ is the least uncountable ordinal. Let = UjeJ Pj 
be the supremum ordinal of all f3j. Note that (3 is a countable ordinal since I is countable 
and J C I. It then follows, by Definition EH that TfTjGWg] and T[T;GW \ are identical 
branching plays. Thus T[Tj]j g / € W^+i C W Wl . Hence W Wl+ i C W U1 as desired. □ 

The result of Lemma 16.81 can be shown to be strict. One can indeed construct a pL/i 
game Q F such that W a C ^ X F for every countable ordinal a. We refer to Lemma 6.3.8 in 
|25j for a proof of this fact. 

We now show that each set in the chain {W a } a < £Jl , having <&^ X F as limit, is provably 
universally measurable in ZFC + MA^ 1 set theory. 
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(P,F) 

Figure 4: Markov branching play M[Aj]i 6 j 

Lemma 6.9 (MAnJ. If 1C lgy^ XF % s universally measurable then so is W(X), i.e., the 
function W maps universally measurable sets to universally measurable sets. 

Proof. By Definition 16.44 we need to show that W(X) = m^{^ F ) is universally measur- 
able. By application of Theorem 14.201 and Theorem l2.1(Ji the winning set $> F is provably 
universally measurable in ZFC + MA^ 1 . The desired result then follows by application of 
Lemma 16.31 and Theorem 12.8( b). □ 

The techniques adopted in this section can be trivially adapted to get the expected 
dual results which we simply summarize in the following proposition. 

Proposition 6.10. The following assertion holds for every pLfj,® formula vX.F and inter- 
pretation p: 

(1) the winning set <& uX - F is the greatest fixed point of the operator W, 

(2) gfp(W) = f] a<Wl W a , where W a = f)p <a W(W^), 

(3) (MA^) for every countable ordinal a, the set W a is universally measurable. 



7. Robust Markov Branching Plays 

In this section we identify a property of Markov branching plays in pL/i games which will 
be used in the proof of Theorem 15.51 in the next section. 

Given a pL/U® game G F , with F a pL/i® formula (having a free variable X) and p a [0, 1]- 
interpretation of the variables, respectively, we extend the graphical notation, introduced in 
Section [6] for branching plays, to Markov branching plays in the expected way. Thus, given 
a Markov branching play M in G F rooted at (p, F) (for some state p), we depict M as in 
Figure [Hand denote it by M[Aj]i 6 j, with Aj G [0, 1] being the probability labeling the edge 
connecting (pi,X) with T. Note that, by definition of the game Q F , the value Aj coincides 
with p{X){pi), for iE I. However, it is convenient to consider, as a technical tool, Markov 
branching plays of the form M[Aj]jgj having A,, for iEl, of an arbitrary value, even though 
these plays never really correspond to achievable plays in Q F . The associated probability 
measure Pjif [Aj] ieI over branching plays in Q F is defined as expected. 

Definition 7.1 (Robust Markov branching plays). Fix a pL^i® formula F (with a free 
variable X) and a [0, 1] -interpretation p. We say that a Markov branching play M[Aj]j e _j in 
Qp , for I C N, is robust in the variable X, or just robust when X is clear from the context, 
if for every e > the following properties hold, 

(1) E(M[ 7i ]) > E(M[Af]) - E i6 / #r> and 

(2) E(M[^])<E(M[A J ]) + E ie /^r, 
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Figure 5: Illustrative example. The symbol A, denotes the value 1 — Aj. 



for every sequences {7i}ig/ and {5j}j e / of reals in [0, 1] such that, for every i G /, the 
inequalities 7j > Aj — and Si < Aj + hold (see Definition 12.41 of # : N — > N) . 

The notion of robustness captures a useful substitutivity property. If, in a Markov 
branching play M[Aj]jgj, the probability Aj of reaching from the state (pi,X) the winning 
(for Player 1) state T is replaced with a smaller but close enough value ji, then the resulting 
Markov branching play Mpyijigj has an expected value close to that of M[Aj]j e / too. 

Note how, in Definition 17.11 the constraint on the distance between 7, (<5j) and Aj 
crucially depends on the index Definition 17.11 has been identified to meet the nature 

of Markov branching plays in pL/x® games and, as we shall see in the next section, every 
Markov branching play in a pL/x® game is indeed robust in every free variable. However, it 
is useful to observe that the dependence on % G I for the constraint on the distance between 
7i (Si) and Aj is necessary. Indeed, the simpler property 



for some constant values c\, C2 G (0, 1), is not satisfied (in general) by pL/i® Markov branch- 
ing plays. In other words, Markov branching plays in pL/z® are not stable (in their expected 
value) if the values Aj are altered uniformly, i.e., by a fixed C2 >0. Consider, for example, 
the Markov branching play, having countably many holes, depicted as in Figure Assume 
that Aj = 0, for every iGN and fix some C2>0. Then it is simple to verify that E(M[Aj]) = 
and E(M[<5j]) = l (where <5j = C2, for all i€l), contradicting (2') above. This phenomenon 
reflects the discontinuity of the denotational interpretation of pL/i® formulas on the free 
variables (see Proposition 13. 5p . Indeed note that the play of Figure [5] is a Markov branching 

play of a pL/x® game associated with a formula of the form p:X.(Y X) = f P > o! r , similar 
to the one discussed in the proof of Proposition 13.51 

We now establish a useful property relating expected values of Markov branching plays 
in and in the game Qp X ' . Again, following established notation, we denote with 
M[Mi]i£i the Markov branching play depicted as in Figure El The Markov branching pre- 
play M[xi\i & i captures the common structure of the Markov branching plays M[Mj]j e j and 
M[Aj]j g / in Qp X ' F and Qp, respectively. 

Lemma 7.2. Let fiX.F be a pLfi & formula and p a [O,l]-interpretation of the free vari- 
ables. Let M[Mi]i£i be a Markov branching play in Qp X ' F . For an ordinal (3, let = 



(2') E(M[Si\) < E(M[Aj]) + ci where Vi.(5< < Aj + c 2 ) 



(7.1) 
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Figure 6: Markov Branching play M[Mj]j £ / 

^Mi(Uo</3 W a ) &e i/ie probability of the event U a <^ W a (see Lemma UT8\) associated with 
the sub-Markov branching play Mi, for iE.1. Then the equality 

^M [ M i ] i6/ (W /3 )=P M[Tf]is/ (^) 

holds, where Q F is the winning set of the game G F ■ 

Proof. Consider the function mx, as specified in Definition 16.21 Recall that, by definition, 
the equalities 

W^ = U^W(W Q )=m LJ i <;3WQ (^) 

hold. The proof is completed by showing that the following property holds: 

P ^( m iLwJ Jf )) = P M[7fc(4 (7-2) 

for every Borel measurable set X C BV F , where BV F denotes the set of branching plays 
in Q F . Indeed the desired result follows from Equation 17.21 by taking X = <& F . Since 
probability measures in Polish spaces are regular, we can restrict X to range over basic 
open sets. Equation 17.21 can then be proved, with routine techniques, by induction of the 
complexity of basic open sets Ot (see Definition 14. 5p . i.e., on the size of the finite tree T. □ 

Note that, as observed earlier, the Markov branching play Mpyjjjgj considered in Lemma 
17.21 might not be a real play in Q F , i.e., one induced by a strategy profile. This is the case 
when ji^ p(X)(pi) for some i£l. 



8. Proof of Equivalence of Game and Denotational Semantics 

This section is devoted to the proof of Theorem 15.51 The proof technique we adopt is 
based on the unfolding method of The unfolding method can be roughly described as 
a technique for proving properties of (some sort of) two-player parity games by induction 
on the number of priorities used in the game. Usually, the first step is to prove that the 
property under consideration holds for all parity games with just one priority. Then the 
the general result for games with n + 1 priorities follows by some argument making use of 
the inductive hypothesis. In our setting we are interested in two-player meta-parity games 
of the form Gp, and the property we want to prove is that the lower and upper values of 
these games coincide with the denotational value of F under the interpretation p. We prove 
this by induction of the structure of F rather than on the number of priorities used in the 
game G F ■ This allows a more transparent and arguably simpler proof. The structure of our 
proof closely resembles the one of [26], where the equivalence of the game and denotational 
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semantics for the logic pL^ is proved using the unfolding method. In the present context, 
the proof is a significantly more technical undertaking due to the complexity of two-player 
meta-parity games: the A^-complexity of the winning sets (Theorem l4.20p . their transfinite 
inductive characterization up to the first uncountable ordinal uj\ (Theorem l6,8p and the dis- 
continuity in the free variables of the denotational semantics (see Theorem 13.51 and Section 
[7]). In what follows, we shall focus primarily on the novel aspects of the proof, referring 
to [26] for a detailed analysis of the simpler cases that easily generalize to the present setting. 

We prove, by induction on the structure of the formulas that, for every PLTS C = 
(P, {— -^} a eL), pL/i® formula F and [0, l]-interpretation p of the variables, the following 
assertions hold: 

IF} P (P) = VAL^)((p,F» = VAL t (^)((p,F}), (8.1) 

and 

M is robust in the variable X (see Definition 17. ip (8-2) 
for every free variable X in F, and Markov branching play M rooted at (p,F) in Q^. 

Base case: F X, for some variable l£ Var. 
It follows immediately by application of Theorem 14.221 that point 18.11 holds. For what 
concerns point 18.21 a Markov branching play M rooted at (p, X) in is of the following 
form: 

T 




Ao \ / 1 - A 

(po,X) 

where A = p{X){p). Thus, M has only one hole (i.e., M = M[A ]) and E(M) = A . The 
Markov branching play Mpy], can then be depicted as above, replacing Ao with 7, for every 
7G [0, 1]. Therefore, E(M[7])=7 and point IHT21 is trivially satisfied as desired. 

Inductive cases F = Gi * G2 or F = oG, for *e { V, A, •, 0} and og{(o), [a]}. 
For all these cases, the proof of point [8Tl follows easily by application of Theorem l4.22i The 
result can be proved following the same lines of the proof of (the corresponding inductive 
cases of) Theorem 5.1 in [26J, thus we omit the routine details. 

We now prove that point [ST21 holds for F = G\ ■ G 2 . The other cases can be proved 

in a similar way. Let us consider an arbitrary Markov branching play M in Qff rooted 

at (p,G\ ■ G2). Then, M can be depicted as follows, where M\ and M2 denote the two 

sub-Markov branching plays rooted at (p, G%) and {p, G2). 

Mi M 2 
_ — — — 

(p^i> {p:g 2 ) 

(P,G!-G 2 ) 

Note that, by definition of the game Qj,, the sub-Markov branching play M, is also a Markov 
branching play rooted at (p,Gi) in the game Qp, for i €{1,2}. Also note that X is free in 
both G\ and G 2 , since it is free in G by assumption. Let M[xi]i^j be the Markov branching 
pre-play obtained by pruning M at the states of the form (pi,X), as described in Section 
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El Let Ai, for i€l, be the probability labeling the edge connecting the i-th. hole in M (i.e., 
the state (pi,X)), to the state T. By Definition 17.11 we need to prove that 

(1) E(M[ 7i ] ieJ ) > E(M[Ai]i e /) - £, e / and 

(2) E(M[^] <6/ ) < E(M[Xi] ieI ) + ^ 

hold, for every sequence { 7 j}jg/ and {5i}i<zi of reals in [0, 1] such that, for every i€ JCPJ, 
the inequalities 7 i > Aj — and <5j < Aj + hold. We just show how to prove the first 
inequality because the second one can be proved in a similar way. 

Let I\ and / 2 be the partition of the index set / specified as follows. The index zEl of 
a path Si in M[xi\i^i (connecting (p, G\ 0G2) with the hole (pi,X)) is in I\ if st lies in Mi, 
i.e., its second state is (p, Gi). Similarly, the index i belongs to I2 if Sj lies in M 2 . Note that 
I\ indexes all the holes of the sub-Markov branching play M\ and, similarly, I2 indexes the 
holes of M-2- Thus, let us denote with M\\x^\^i x the Markov branching pre-play associated 
with M\, and similarly for M 2 [xj]j g / 2 and M 2 . Then, by the inductive hypothesis on the 
complexity of Gi and G2, we know that Mi and M 2 are robust in X, i.e., the following 
assertions, with respect to inequality (1) above, 

a) E(Mi[7i] feIl ) > E(Mi[\i] ieh ) - Z ieh Wfi, and 

b) E(M 2 [ 7i ] ie/2 ) > mUH^h) ~ £ 

hold. By applying the product measure technique adopted in the proof of Theorem 14.221 
it is easy to verify that the equalities E(M[Aj]jgj) = E(Mi[Aj]j G j 1 ) • E(M 2 [Aj]j g / 2 ) and 
E(M[7j]j e /) = E(Mi[7j]i e / 1 ) • E(M 2 [7j]j g / 2 ) hold. The desired equation (1) above can then 
be derived as follows: 

E(M[ 7< ] ieJ ) = E(M 1 [ 7i ] fcJl )-E(M 2 [ 7i ] i6/2 ) 

> 6) E(M 1 [ 7l ], e/l ) • (E(M 2 [A i ] i6/2 ) - Zjeh 5&r) 

>* (E(Mi[ 7i ] i6/l ) • E(M 2 [A J ] je/2 )) - E ie j 2 27+T 

>«) ((E(M 1 [A J ] i6/l ) - E ieh #t) • E(M 2 [A,-] je/2 )) - £ je / 2 ^ 

>* (ECMiMie/J • E(M 2 [Aj]j- e / 2 )) - £ i6/l #r - E ie / 2 #r 

> /=/lW/2 (E(Mi [Ai] i6/l ) • E(M 2 [Aj]j £ / 2 )) - E i6 / 2irr 
E(M[A^ e/ )-£ ieJ2 £r 

where the steps labeled with (*) are valid because all terms have values in the interval [0, 1]. 
Inductive case F = /iX.G. 

• We first prove that point 18.11 holds. 
For every state p and every interpretation p we have, by definition of the denotational 
semantics, that the following equality holds: 

\PX.GUP) = lfp(A/€ [0, lf.{lGj p[f/x] ))(p). 
By the Knaster-Tarski theorem, the previous equation can be rewritten as: 

lnX.G} p (p) = [_|[G]« (8.3) 

a 

where a ranges over the ordinals, and [GJ" is defined as U^aJ^Jp^G^/x] ' us denote 
with 7 the least ordinal such that IG}J = ffiX.GJp, and with /? 7 € [0, l] p the interpretation 
p[|[G]]p/AC]. Thus, the following equation holds: 

[GJ P7 = lnX.Gj p . (8.4) 
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Let us now turn our attention to the 2^-player meta-parity game Qp ' . Our goal is 
to prove that point \87T\ holds, i.e., that the following equalities 

yx.GUv) = VAL 4 (^ XG )((p^XG}) = \ZAL t {gf- G )((p^X.G)) (8.5) 

hold, for every p£P. As a first observation, note that the state (p,fiX.G) is not reachable 
by any other game state, and that it has the state (p, G) as its only successor state. It then 
follows by application of Proposition 14.221 that, in order to prove the desired result (|8.5j) . 
we just have to show that the equalities 

\G\ Pi {p) = VAL ; (^ G )«p,G}) = VAL t (^ tXG )((p,G)) (8.6) 

hold. In order to improve readability, we shall denote with (| [iX.G [)* :P— >■ [0, 1] the function 

defined as Ap€ P. (VAU(^ XG ) ((p, G})) , for*e{j,t}. Thus, EquationEScan be rewritten 

as follows: 

[G]p» = ^X.G^p) = ^X.Gf p (p). (8.7) 
Note that the analogous functions d ^Dpfj/x] :P — >[0, 1] specified, for f}, as 

XpG P. (Val* (Gp^f/x]) ((P) ^*))J ' satisfy the following equation: 

lG} p[ f/x ] = m i p[f/x] = <lGf p[f/x] (8.8) 

for all f £ [0, by induction hypothesis (18, ip on G. 

We prove Equation 18.71 by exploiting the similarities between the game Qp X ' G and the 
game Qptf/x] ) already discussed in Section [6l Our first observation is the following: 

^X.G) P = flGD^xGDjS/x] Eq=E21 [I G 'lp[^^G*^/x] (8.9) 

for *G {4, f}- Indeed when a state of the form {p, X) is reached in the game Qp X ' G the play 
continues from the state (p, G) and ends in a victory for Player 1 with (lower or upper) 
value d \xX .G \)p(p) , and, similarly, when the state (p,X) is reached in Qpt^x Gh*/X]' 
play immediately terminates in favor of Player 1 with probability d /j,X .G \j*(p) . 

By application of Equation 18.81 this implies that both <\fiX.G\)j, and <\fiX.G\)p are 
fixed points of the functional A/ E [0, l] p .([[G]]p[j/x])- Note that, for all p € P, the in- 
equality d [iX .G \)p(p) < d iiX .G Dp(p) trivially holds. Moreover the inequality [pX.G]]p(p) < 
|^XG||(p) holds, for all p£P, because [[//X.GJp (or, equivalently, [G]p ) is the least fixed 
point of A/, 0. 1 ''.fY;;,,/ v )■ 

We shall prove the desired result (Equation 18. T|) by showing that, for all p G P, the 
inequality 

^X.G)l(p) A ^ Val\gf- G )({p,G)) < IGjp^p) (8.10) 
holds. We do this by constructing, for every e > a strategy a\ for Player 2 in the game 
Qp X ' G , satisfying the following inequality: 

L|E(M^g)<[Gl P » + e . (8.11) 
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The strategy erf is constructed using the collection of <5-optimal strategies, for 5>0, in 
game , i.e., strategies r| such that the following equality holds: 



□ E(M<^ } ) < VAL(0£)«p,G» + ^ q =^[Gl P7 (p) +5. (8.12) 



Let e:?^g->N be a numbering (i.e., an injective map into the natural numbers) of the 
finite paths in the game Qp X ' G . The strategy erf is defined, for every e>0, as follows: 
r 2 2 (s) if s does not contain states of the form (p, X) , for p E P 

400 



^2 #(e S j ^ last^gj) = (p,X) for some pE-P 

for every finite path s whose last state belong to Player 2 (i.e., such that last (a) SS2), where 
the function # : N — > N is specified as in Definition 12.41 The strategy erf can be informally 

described as follows. When the game begins erf behaves as the strategy r 2 2 until a state of 
the form (p, X) is reached. This is a good definition because plays in the two games Qp X ' G 
and are identical until states of this form are reached. If a state of the form (p, X) is 
eventually reached following some path Sj, then Player 2 improves their strategy, and plays 
the rest of the game (starting at the unique successor state (p,G) of (p, X)) in accordance 



with the better strategy a\ #<e(S:i>> . Note how the choice of the new strategy to be followed 
crucially depends on the path Sj. 

We are now going to show that, for every e > 0, the strategy erf satisfies the desired 
inequality 18.111 We need to show that, for every strategy o\ for Player 1, the inequality 

E(M^g)<[G] p >) + e. (8.13) 

holds. Recall that, by definition, E(M* 1 a e ) =F*i oj (^)> where P^'^e denotes the probability 

measure over branching plays in Qp X ' G induced by the Markov branching play a e , and 

$ denotes the set of winning branching plays for Player 1 in Qp ' . By Theorem 16.71 and 
Lemma 16.81 we know that & = [J a<U)1 W a . Thus, the previous equation can be rewritten as 
follows: 

<'3( U W «) <IGl P >) + e. (8-14) 

By application of Theorem 12.101 under the set-theoretic assumption MA^ we can further 
rewrite the previous equation as follows: 

U ( p £S(W«)) <[G%,» + £. (8.15) 

This step allow us to set up a proof by transfinite induction for the desired Equality 18.111 
We shall now prove that for every countable ordinal /3 < uj\ and every e > 0, the inequality 

P?/5(W^)<[Gfl p >) + £. (8.16) 

holds. Assume Equation 18.161 holds for every ordinal a < (3. The Markov branching play 
M^ G ] can be depicted, following the notation introduced in sections [6] and as in Figure 
By definition of erf, the sub-Markov branching plays Mi, for i&I, are Markov branching 
' :,K '"" -rf*, with £j = I ■ ff( e (g-.)) 



plays played in accordance with the strategy <rf 4 , with £j = | • „ , | ? ^ . Let us denote with 
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(pi,X) 











Sr<lGj Pl ( P ) + --^ rj ^ (8.17) 



Figure 7: Markov Branching play M[Mj]j 6 _r 
T J_ T I 

<5 \/l-<5 ^X/ 1 
---^ v (po,^) y (Pi,^Q 



Figure 8: Markov branching play M[<5j]j e j 

5f the value PMj(W tt ), where denotes the probability measure associated with Mj, and 
a < j3. Moreover, let us denote with <5j, for iEl the value Uo</3^f- Then, by induction 
hypothesis on the ordinals, we know that, for every a</3, the inequality 

e 1_ 

2 ' #R"s-)) 

holds, for every i El. By application of Lemma 17,21 we know that the following equality 
holds: 

^;%(Wp) = B(M[6 t ] teI }) (8.18) 

where M[5j]j g j denotes the Markov branching play in the game Q%, obtained from M^'^l 
as specified in Section which can be depicted as in Figure El Let us denote with Aj, for 
i£ I, the value {Gj p 7 (pi). Observe that the Markov branching play M[Ai]jgj (depicted by 
replacing 5, with Aj in Figure [8]) is a Markov branching play in the game Q^,. Moreover, by 
definition of <r|, the Markov branching play M[Aj]j e j is played by Player 2 in accordance 

with the |-optimal strategy r 2 2 . It then follows by Equation 18.121 that 

B(M[X^ I )<lGj Pl (p) + £ - (8.19) 

Recall that, by induction hypothesis (|8.2p on G, the Markov branching play M[Aj]j G / is 
robust is the free (in G) variable X. Thus the following inequality holds: 

E(Mft] i6J ) < E(M[Ai] i6J ) + E (| • #(^)) ) ■ (8 - 20) 

Since the numbering e is injective, it follows from equation 18. 191 and 18.201 that E(M[^]j g /) < 
[G]p (p) — | — | . Thus, Equation 18.161 holds as desired. 

• We now prove that point 18.21 holds. 
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(P0,G) (Pi,G) XQ \ / XQ \ / 

j | A \ / \ \ I 

s (Po,X) (p h X) ^- . ( P o,X) (pl'x) 

(a) Markov Branching play M (b) Markov Branching play M[\f]i^i 

Figure 9: Markov branching plays M = M[Mi] ieI in ^ X ' G and M[Xf] ieI in f?^ 



We just discuss the main ideas of the proof as the necessary techniques have been already 
introduced in the proof of point 18.11 above. 

We need to show that every Markov branching play M in Qp X ' G , rooted at (p,fiX.G) 
is robust in every free variable Y. Clearly Y^X, since X is bound in \xX.F. As already 
observed earlier, we can just consider Markov branching plays M rooted at (p, G), since the 
state (p, /iX.G) has (p, G) has its only successor state, and it is not reachable by any other 
states. Let JCN be the set indexing the paths from the root {p, G) of M to states of the 
form (pj,Y). Let us denote with M[yj]j^j the associated Markov branching pre-play. Let 
Xj £ [0, 1], for j € J, be the value labeling the edge connecting the j-th hole in M with the 
state T, i.e., Xj = p(Y)(pj). Thus M = M[Xj]j^j. We need to prove that, for every e > 0, 
the inequalities 

(1) E(M[ 7i ] i6j ) > E(M[A i ] ieJ ) - £. £J 2^r, and 

(2) E(M[Sj} je j) < E(M[Xj] jeJ ) + E i6J 2^t- 

hold for every sequences {^j}j<zj and {5j}j e j of reals in [0,1] such that, for every j€ JCN, 
the inequalities 7 j > Xj — ^|jy and 5j < Xj + -^-^ hold. We just consider the first inequality, 
as the second one can be proved in a similar way. 

Recall that, by application of Theorem 12. 10| under the set-theoretic assumption MA^, 

the equality E(M[ 7i ] ieJ ) d = P M [ 7j ] jeJ ($) = U^^y^a) holds. Similarly for 
E(M[Xj]j e j). We shall then prove (1) above, by proving the following more general prop- 
erty: for all Markov branching plays M = M[Xj]j^j in Qp X ' G rooted at (p, G) and sequence 
{ 7 j}j € j as described above, the following equality holds: 

This is proven, again, by transfinite induction on the ordinals. Suppose the property holds 
for all a < /3. The main idea to prove the inductive step is to reduce the problem on M 
(which can be depicted as in Figure 9(a) by exposing the collection of paths reaching states 
of the form (pi,X), for an index set I) to that of M[Xf] ieI (where Xf = F AU (\J a<)3 W a )), the 
Markov branching play in constructed as described in Lemma [7.2l and depicted in Figure 
|9(b)[ The result then follows by applications of Lemma 17.21 (relating the values Pm(W i s) 
and of E(P A /[ A a])), by induction hypothesis on a (I8.21|) and by induction hypothesis (j8.2j) 

on the robustness of the Markov branching plays M[Xf]i^j in Q^. We omit the technical 
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details. A detailed proof of (a generalized version of) this result can be found in [25, §4.3]. 

Inductive case G = ^X.G. 
Similar to the previous one and based on the properties summarized in Proposition 16 . 1 01 

8.1. Remarks about the use of MA^. We conclude this section by highlighting the two 
critical steps in our proof where the set-theoretic assumption MA^ is used. 

As already discussed in Section [5J we make use of Martin's Axiom at Ki to ensure that 
the A<j, winning set of a pL^® game is universally measurable. The universal measur ability 
of A2 sets can, however, be proved in other extensions of ZFC. For example, determinacy- 
based axioms such as Analytic Determinacy [IS], suffice (see, e.g., [El §36.E]). 

The second use we make of the axiom MA^ is in the derivation of Equation 18.151 
in the proof above. This is a fundamental step required to set up a proof by transfinite 
induction on the countable ordinals. As stated in Theorem 12 .101 one of the consequences of 
Martin's Axiom at ^1 is that probability measures on Polish spaces are wi-continuous. Such 
a property, clearly implying the negation of the Continuum hypothesis, does not follow from 
determinacy-based axioms mentioned above. As mentioned after Lemma 16.81 our inductive 
characterization of the winning set of pL//® games, can be shown to require, in general, 
wi-iterations (i.e., approximants) to converge. Thus some form of wi-continuity seems to 
be required by the proof technique adopted in this Section. 

9. Conclusions and Future Work 

One of the primary interests in a game semantics for pL/i®, and more generally for all 
logics having a [0, l]-valued semantics with an intended probabilistic reading, is to offer an 
accessible and clear interpretation for the property described by a formula. We suggest 
that our game semantics, built on top of the elementary idea of concurrent execution of 
independent sub-istances of the game, succeeds in this task. The logic pL/i® is expressive 
enough to encode the qualitative threshold modalities P>o and P=i which, as discussed at 
the end of Section are interpreted within the game semantics in a straightforward way. 

Despite the naturalness of the definition, our proof of equivalence is a technically under- 
taking. Our result, based on a transfinite characterization of pL/i® winning sets, is carried 
out in ZFC + MA^j set-theory to deal with the measure theoretic complications associated 
with the complexity of winning sets. We are not aware of any other result in theoretical 
computer science whose proof is (or at least was originally) carried out in proper extensions 
of ZFC set theory. Thus, our proof of determinacy, which is generalized in [25J from the 
pL/x® games considered in this paper to arbitrary two-player stochastic meta-parity games, 
is perhaps noteworthy as being a first example of this kind of result. 

Although the logic pL^® subsumes the qualitative fragment of the logic PCTL of [2], 
it does not seem possible to encode the full logic PCTL within pL/x®. In |25j an extension 
of pL/i®, obtained by adding to the syntax of the logic yet another pair of De Morgan 
dual connectives, is considered. Interestingly, this extension, which is capable of encoding 
the full logic PCTL, can be given an appropriate game semantics in terms of two-player 
stochastic meta-parity games. We refer to [25] for a proof of this fact, which serves as a 
demonstration of the expressive power of the new class of two-player stochastic meta-parity 
games introduced in this paper. 
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Our work leaves open several directions for future research. Prom a theoretical point of 
view, it would be interesting to remove the dependencies on the set-theoretic assumption 
MAftj from our proof. This, in light of the remarks of Section 18.11 looks as a challenging 
task. In another direction, it would be interesting to investigate the theory of two-player 
stochastic meta-games. Preliminary results, such as the fact that Blackwell games can 
be encoded as tree games and that the open problem of qualitative determinacy [6] for 
stochastic games can be formulated as a determinacy problem for tree games, are obtained 
in the author's PhD thesis [25]. However, several questions remain open. For example, 
the concept of independent execution of actions in two-player games have been already 
considered as a tool for understanding logics of imperfect information (see, e.g., [I], |12j). 
It is then be natural to explore the expressive power of tree games in this setting. A very 
general class of two-player games with concurrent behaviors, based on event structures, has 
recently been considered in [9] where a determinacy theorem is obtained for games satisfying 
appropriate restrictions. Comparing our notion of tree games with their concurrent games, 
and the corresponding determinacy results, looks like a promising direction for future work. 
Similarly, it is interesting to compare two-player non-stochastic meta-parity games with 
the, apparently very similar, hierarchical four player games (2 vs 2) of [H], which are used 
to formalize the semantics of first order logic extended with game quantifiers. Developing 
verification methods is another source of possible research directions. For instance, it is 
interesting to study the model checking problem for the logic pL/x®. Is it possible to compute, 
or at least approximate to an arbitrary degree of precision, the value [-Fl(p) assigned by 
a formula to a state p of a finite PLTS? The problem seems far from trivial. A source of 
difficulty comes from the fact that (finite) two-player stochastic meta-parity games are not 
positionally determined. We refer to |25} §8] for an overview of these issues. 
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